<?xml version="1.0" encoding="ISO-8859-1"?>
<metadatalist>
	<metadata ReferenceType="Conference Proceedings">
		<site>sibgrapi.sid.inpe.br 802</site>
		<holdercode>{ibi 8JMKD3MGPEW34M/46T9EHH}</holdercode>
		<identifier>8JMKD3MGPEW34M/3U2KT7L</identifier>
		<repository>sid.inpe.br/sibgrapi/2019/09.10.01.51</repository>
		<lastupdate>2019:09.10.01.51.16 sid.inpe.br/banon/2001/03.30.15.38 administrator</lastupdate>
		<metadatarepository>sid.inpe.br/sibgrapi/2019/09.10.01.51.16</metadatarepository>
		<metadatalastupdate>2022:06.14.00.09.35 sid.inpe.br/banon/2001/03.30.15.38 administrator {D 2019}</metadatalastupdate>
		<doi>10.1109/SIBGRAPI.2019.00031</doi>
		<citationkey>BastosMeloSchw:2019:MuReRe</citationkey>
		<title>Multi-Loss Recurrent Residual Networks for Gesture Detection and Recognition</title>
		<format>On-line</format>
		<year>2019</year>
		<numberoffiles>1</numberoffiles>
		<size>863 KiB</size>
		<author>Bastos, Igor Leonardo Oliveira,</author>
		<author>Melo, Victor Hugo Cunha de,</author>
		<author>Schwartz, William Robson,</author>
		<affiliation>Universidade Federal de Minas Gerais</affiliation>
		<affiliation>Universidade Federal de Minas Gerais</affiliation>
		<affiliation>Universidade Federal de Minas Gerais</affiliation>
		<editor>Oliveira, Luciano Rebouças de,</editor>
		<editor>Sarder, Pinaki,</editor>
		<editor>Lage, Marcos,</editor>
		<editor>Sadlo, Filip,</editor>
		<e-mailaddress>igorcrexito@gmail.com</e-mailaddress>
		<conferencename>Conference on Graphics, Patterns and Images, 32 (SIBGRAPI)</conferencename>
		<conferencelocation>Rio de Janeiro, RJ, Brazil</conferencelocation>
		<date>28-31 Oct. 2019</date>
		<publisher>IEEE Computer Society</publisher>
		<publisheraddress>Los Alamitos</publisheraddress>
		<booktitle>Proceedings</booktitle>
		<tertiarytype>Full Paper</tertiarytype>
		<transferableflag>1</transferableflag>
		<versiontype>finaldraft</versiontype>
		<keywords>Gesture detection, gesture recognition, recurrent models, multi-task.</keywords>
		<abstract>Communication through gestures plays a relevant role in human life, in which a non-verbal language is used to propagate information among individuals. To recognize gestures, computers need to represent and interpret human appearance and motion, involving hands, arms, face, head and/or body, in a mathematical sense. Despite the high applicability in different contexts, most gesture recognition approaches in literature are not designed to deal with unsegmented videos. That is, most approaches do not temporally detect when a gesture occurs, which prevents to explore correlations between detection and recognition tasks, besides their application on real-world scenarios. In this sense, we propose the Multi-Loss Recurrent Residual Network (MLRRN), a multi-task based approach that performs both the recognition and temporal detection of gestures at once. It employs a dual loss function which takes into account the class assignment of each frame of a video to a gesture class and also determines the frame interval associated to each gesture. Our model counts with a dual input, gathering information from appearance and human pose on frames, besides bidirectional recurrent layers and residual modules. According to experiments conducted on ChaLearn Montalbano and ChaLearn ConGD datasets, our approach achieves results comparable to state-of-the-art methods considering average temporal Jaccard metric.</abstract>
		<language>en</language>
		<targetfile>camera_ready_mlrrn.pdf</targetfile>
		<usergroup>igorcrexito@gmail.com</usergroup>
		<visibility>shown</visibility>
		<documentstage>not transferred</documentstage>
		<mirrorrepository>sid.inpe.br/banon/2001/03.30.15.38.24</mirrorrepository>
		<nexthigherunit>8JMKD3MGPEW34M/3UA4FNL</nexthigherunit>
		<nexthigherunit>8JMKD3MGPEW34M/3UA4FPS</nexthigherunit>
		<nexthigherunit>8JMKD3MGPEW34M/4742MCS</nexthigherunit>
		<citingitemlist>sid.inpe.br/sibgrapi/2019/10.25.18.30.33 2</citingitemlist>
		<hostcollection>sid.inpe.br/banon/2001/03.30.15.38</hostcollection>
		<username>igorcrexito@gmail.com</username>
		<agreement>agreement.html .htaccess .htaccess2</agreement>
		<lasthostcollection>sid.inpe.br/banon/2001/03.30.15.38</lasthostcollection>
		<url>http://sibgrapi.sid.inpe.br/rep-/sid.inpe.br/sibgrapi/2019/09.10.01.51</url>
	</metadata>
</metadatalist>